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|W  AOSTRACT 


The  detection  and  false-alarm  probabilities  for  maximum  likelihood  detection  of 
coherent  signals  in  no'se,  where  the  signal  and  noise  levels  are  unknown,  are  derived  and 
evaluated.  The  maximum  likelihood  detector  is  shown  to  be  optimum  in  the  following  sense: 
out  of  the  class  of  processors  that  yields  a  specified  false-alarm  probability  without  knowl¬ 
edge  of  the  noise  level,  It  is  uniformly  most  powerful  for  unknown  (positive)  signal  level. 

For  M  samples  of  signal-plus-noise  or  noise,  and  N  samples  of  noise-alone,  curves  of 
detection  probability  versus  signal-to-noise  ratio,  with  false-alarm  probability  as  a  param¬ 
eter,  are  presented  for  values  of  M  +  N  ranging  from  2  to  27.  Curves  of  signal-to-noise 
ratio  required  for  0. 5  detection  probability  are  presented  for  several  values  of  false-alarm 
probability. 

Detection  performance  improves  very  rapidly  as  M  +  N  increases  from  2  to  4  or  5;  the 
degree  of  improvement  for  larger  M  +  N  depends  on  the  exact  value  of  false-alarm  prob¬ 
ability  desired.  For  example,  small  false-alarm  probabilities  such  as  10"®  require  ten  or 
more  total  samples  before  the  performance  improvement  begins  to  slacken  with  the  number 
of  samples  taken. 
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ABSTRACT 


The  detection  and  false-alarm  probabilities  for  maximum  likelihood 
detection  of  coherent  signals  in  noise,  where  the  signal andmoise  levels 
are  unknown,  are  derived  and  evaluated.  The  maximum  likelihood  de¬ 
tector  is  shown  to  be  optimum  in  the  following  sense:  out  of  the  class 
of  processors  that  yields  a  specified  false-alarm  probability  without 
knowledge  of  the  noise  level,  it  is  uniformly  most  powerful  for  unknown 
(positive)  signal  level. 

For  M  samples  of  signal-plus-noise  or  noise,  and  N  samples  of 
noise- aloiie,  curves  of  detection  probability  versus  signal- to- noise  ratio, 
with  false-alarm  probability  as  a  parameter,  are  presented  for  values 
of  M  +  N  ranging  from  2  to  27.  Curves  of  signal-to-noise  ratio  required 
for  0.5  detection  probability  are  presented  for  several  values  of  false- 
alarm  probability. 

Detection  performance  improves  very  rapidly  as  M  +.N  increases 
from  2  to  4  or  5;. 'the  degree  of  improvement  for  larger  M  +  N  depends 
on  the  exact  value  of  false-alarm  probability  desired.  For  example, 
small  false-alarm  probabilities  such  as  10” 6  require  ten  or  more  total 
samples  before  the  performance  improvement  begins  to  slacken  with 
the  number  of  samples  taken. 
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OPERATING  CHARACTERISTICS  FOR  MAXIMUM  LIKELIHOOD 
DETECTION  OF  SIGNALS  IN  GAUSSIAN  NOISE 
OF  UNKNOWN  LEVEL 

I.  COHERENT  SIGNALS  OF  UNKNOWN  LEVEL 


INTRODUCTION 

Signal-detection  systems  often  are  required  to  operate  in  environments 
where  the  background  noise  level  is  subject  to  unknown  variations .  For  exam¬ 
ple,  receivers  for  active  sonar  (dr  radar)  are  called  upon  to  process  returns 
against  interference  that  includes  time -varying  reverberation  (or  clutter). 

From  a  practical  point  of  view,  it  can  be  expected  that  both  the  level  and  the 
spectrum  of  the  interference  will  be  unknown  and  changing  with  time.  In  such  a 
situation,  establishing  a  noise-level  reference  for  each  range  (time  delay)  in¬ 
crement-id  obviously  necessary  if  a  specified  probability  of  false  alarm  Pp  is 
to  be  maintained.  The  subject  of  this  report  is  a  study  of  a  detector  that  maxi¬ 
mizes  the  probability  of  detection  Pq  .and  at  the  same  time  maintains  a  desired 
Pp  in  the  presence  of  Gaussian  noise  of  unknown  level  and  spectral  density  (or 
autocovariance  function). 

Signal- detection  applications  m  a  stationary  environment  of  unknown  noise 
power  level  present  a  potentially  simpler  problem  than  the  one  addressed  here. 
In  the  stationary  environment  it  is  likely  that  the  unknown  noise  parameters  can 
be  estimated  independently  of  the  signal  detection  procedure.  Then,  prior  to 
detection,  a  noise-reference  level  could  be  established  to  any  degree  of  accu¬ 
racy,  and  the  desired  false-alarm  probability  could  be  approximately  realized. 

For  the  more  realistic  situation  of  signal  detection  in  a  nonstationary  en¬ 
vironment  with  noise  of  unknown  spectral  density,  a  fixed  detection-threshold 
would  yield  a  varying  false-alarm  probability  dependent  on  changes  in  the  noise 
level  and  spectral  density.  This  undesirable  feature  can  be  alleviated  (at  the 
expense  of  introducing  additional  noise  into  the  detection  procedure)  by  estima¬ 
ting  the  noise  level  at  each  increment  of  time  in  order  to  establish  a  detection 
threshold  that  tends  to  track  the  noise  power  level.  It  is  often  the  case  that  the 
noise  background  is  varying  slowly  enough  in  time  that  independent  samples  of 
noise-alone,. from  the  same  ensemble  as  the  sample  being  tested  for  signal 
presence,  are  available  in  neighboring  time  increments.  Obviously,  extra 
samples  of  noise-alone  can  be  used  to  improve  the  estimate  of  noise  level,  and 
allowance  for  them  is  included  in  this  investigation. 
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It  is  worthwhile  remarking  that  this,  report  is  applicable  to  problems  of 
changing  noise  environments  other  than  just  temporally  nonstationary  examples. 
For  example,  passive  receiving  arrays  generally  operate  in  spatially  noniso- 
tropic  noise  fields;  if  the  samples  of  signal -plus -noise  and  noise-alone  are  as¬ 
sumed  to  be  obtained  from  neighboring-look  directions,  the  results  of  this  in¬ 
vestigation  are  applicable  in  a  spatial  normalization  context.  Or-,  if  a  system 
for  detecting  narrowband  components  in  a  broadband. input  is  considered;  the 
samples  may  be  assumed  to  come  from  adjacent  frequency  bins,  and  the  results 
of  this  investigation  are  also  applicable  in  the  frequency  domain.  To  avoid  an 
unnecessarily  cumbersome  discussion,  however,  the  terminology  of  temporal 
nonstationarity  will  be  employed  throughout  the  remainder  of  the  report. 

It  will  be  recognized  that  inability  to  specify  the  spectral  density  of  the 
noise  places  analysis  within  the  framework  of  a  nonparametric  detection  prob¬ 
lem,  for  which  the  goal  will  be  to  achieve  a  constant  fal?e-alarm-rate  receiver. 
In  the  following  discussion,  it  will  be  assumed  that  the  input  to  the  receiving 
system  has  been  filtered  to  remove  noise  outside  the  signal  band  and  that  the 
prefiltered  input  is  sampled  at  times  sufficiently  separated  fcr  the  samples  to 
be  statistically  independent.  The  approach  will  also  assume  that  the  noise  has 
a  specific  statistical  structure,  namely,  Gaussian,  thereby  casting  the  originally 
nonparametjic  problem  into  a  parametric  form  (although  the  parameters  ap¬ 
pearing;!*! -Ue  probability  density  functions  (PDFs)  are  unknown). 

in  the  general  case ,  the  values  of  the  unknown  parameters  can  be  esti¬ 
mated  by  separately  maximizingdhe  PDFs  for  the  signal  present  hypothesis 
and'signal  absent  hypothesis  HQ.  The  likelihood  ratio  (LR)  formed  under 
these  conditions  (principle  of  maximum  likelihood)  can  be  used  to  obtain  a  gen¬ 
eralized  likelihood  ratio  (GLR)  test.  This  procedure  was  carried  through  by 
Helstrom1  for  coherent  signals  in  Gaussian  noise  of  unknown  level  and  spectral 
density  (no  extra  noise  samples  were  assumed  present  in  his  analysis)  and  re¬ 
sulted  in  a  t-statistic  test.  In  the  coherent  detection  case,  however,  a  more 
powerful  result  than  Helstrorh's  can  be  obtained,  as  shown  by  Scharf  and  Lytle2 
and  as  derived  in  Appendix  A  to  this  report.  The  resultant  t-test  is,  with  un¬ 
known  signal  level,  uniformly  most  powerful  (UMP)  of  all  tests  which  maintain 
a  specified  PF  (irrespective  of  noi3e  level  changes)  and  is  optimum  (in  a 
Neyman-Pearson  sense)  for  the  same  (scaling  invariance)  class  of  tests  when 
the  signal  level  is  known. 

The  problem  of  detecting  a  signal  of  known  form  (but  possibly  unknown 
level)  in  Gaussian  noise  of  unknown  level  has  been  the  subject  of  a  number  of 
investigations.  In  a  parametric  context,  Helstrom*  has  considered  the  question 
of  detecting  signals  in  noise  of  unknown  level  but  known  normalized  autocovari- 
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ance  function.  In  a  series  of  problems,  he  employs  a 'method, of  solution  based 
on  a  maximum  likelihood  estimate  of  the  noise  level,  to  derive  a  t-statistic  test 
whose  asymptotic  reliability  is  as  good  as  that  of  the  known -noise  receiver; 
physical  realization  of  this  processor  is  not  practical,  however.  Scharf  and 
Lytle  have  shown  that  the  t-test  is  LIMP -invariant.  In  the  nonparametric  situa¬ 
tion  (unknown  noise  autocovariance),  Carlyle  and  Thomas3  have  treated  the 
t-statistic  as  an  asymptotically  nonparametric  detector.  Other  authors  have 
considered  receivers  that  employ  a  separate  (extra)  input  exhibiting  the  same 
kind  of  noise  as  that  which  corrupts  the  signal  but  is  known  to  contain  no  signal. 
Capon, 4  Hancock  and  Lainiotis,  and  Carlyle  apd  Thomas3  have  analyzed  a  num¬ 
ber  of  nonparametric  receivers  adapted  from  so-called  Wilcoxon  tests  (both 
with  and  without  extra  noise-alone  samples)  and  have  obtained  asymptotic  rela¬ 
tive  efficiencies  for  several  such  detectors.  Finally,  Spooner,  ®  using  an  aver¬ 
aged  likelihood  ratio-test,  has  treated  the  problem  of  detecting  signals  in  white 
Gaussian  noise  whose  unknown  random  level  is  assumed  to  be  gamma  dis¬ 
tributed. 

This  report  presents  a  self-contained  statement,  including  description? 
and  derivations ,  about  the  maximum-likelihood  and  optimum  scaling-invariant 
procedures  referred  to  above.  The  analyses  in  the  following  sections  not  only 
constitute  a.  review  of  previous  work  on  coherent  detection  of  signals  in  noise  of 
unknown  level,  but  they  also  provide  a  foundation  for  consideration  of  phase- 
incoherent  detection  of  deterministic  signals  and  for  consideration  of  detection 
of  stochastic  signals  in  noise  of  unknown  level.  In  two  important  respects, 
however,  the  present  effort  represents  extensions  of  previous  work.  First, 
allowance  is  made  for  including  extra  samples  of  noise-alone  in  the  maximum 
likelihood  estimates  of  the  noise  power.  Second,  extensive  numerical  results 
are  given  for  the  performance  of  the  maximum  likelihood  (optimum)  detector, 
both  with  and  without  extra  noise -alone  samples. 


PROBLEM  STATEMENT 


Wo  have  available  M  samples  of  either  signal -plus-noise  or  noise,  and 
N  samples  of  noise -alone,  denoted  by  jx^^  and  |yj|i,  respectively.  The 
observation  "vector"  R  is  made  up  of  these  M  +  N  samples: 


XMyi 


(1) 


The  samples  are  assumed  to  be  statistically  independent  of  each  other,  and  the 
noise  is  Gaussian.  The  PDF  of  R  under  H0  is 
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where  it  is  assumed  that  the  noise  variance.  o?  is  the  same  for  all  M+N  sam¬ 
ples.  The  PDF  of  K  under  is 


where  it  is  also  assumed  that  the  signal  strength,  as  reflected  by  the  mean  m, 
is  the  same  for  all  M  signal-plus-noise  samples. 

Various  possible  cases  of  knowledge  about  m  and  <r2  are  summarized 
in  Table  1.  For  cases  (b)  and  (d),  where  m  is  unknown,  it  is  assumed  that  m 
is  known  to  be  positive.  This  means  that  phase -coherent  processing  would  be 
required  in  the  narrowband  signal-detection  mode;  a  phase-tracking  device  would 
be  needed  in  practice.  The  quantities  ait2  are  constants,  which  are  adjusted 
totalize  a  prescribed  Pp. 

The  optimum  processor  for  case  (a),  in  the  sense  of  maximum  Pj)  for 
fixed  Pp  (Ref.  7,  pp.  27-28],  is  indicated  in  the  table.  Its  performance  capa¬ 
bility  Is  governed  by 


Pp  •*  4>(-A),  PQ  =  ~  A) , 


(4) 


where  A  is  a  normalized  threshold,  and  the  cumulative  Gaussian  distribution 


<i>(x)  a 


dt(2ir)"1^2  exp(-t2/2) . 


(5) 


A  desired  Pp  can  be  maintained  by  choice  of  A  since  <r  is  known.  The  pro¬ 
cessor  for  case  (b)  is  identical  to  that  for  case  (a),  and  is  UMP  [Ref.  7,  pp. 
88-92] ;  its  performance  io  identidal  to  that  given  in  (4) .  Samples  |yjJ^  are  of 
no  use  in  cases  (a)  and  (b) . 
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Table  1 

FOUR  .GASES  OF  COHERENT  PROCESSORS 


Case 

< 

Meanm 

Variance  o' 

j  Receiver  Processing 

< 

(a). 

known 

known 

M 

i=l 

Optimum 

(b) 

unknown 

(positive) 

< 

:  known 

M 

i=l 

UMP 

(c) 

■ 

unknown 

M  M  N  vl/2 

i=l  i=l  j=l 

Optimum 

under 

scaling 

invariance 

(d) 

' 

unknown 

(positive) 

unknown 

M  .  M  N  1/2 

e *r  >: 

i=l  i=l  j=l 

UMP 

under 

scaling 

invariance 

Note: 

If  the  upper  inequality  is  satisfied,  declare  Hp 

If  the  lower  inequality  is  satisfied,  declare  HQ. 

Cases  (c)  and  (d)  have  unknown  noise  variance  <r2  and  are  the  situations 
of  interest.  Two  approaches  have  bean  considered.  The  first  is  to  employ  the 
principle  of  maximum  likelihood  (ML)  to  estimate  the  unknown  parameters  and 
to  use  the  GLR.  ?  In  case  (c)  the  resulting  test  has  the  disadvantageous  fea¬ 
ture  that  the  precise  value  of  m  must  be  known  in  order  to  realize  prescribed 
Pp.  In  case  (d)  the  resultant  ML  test  is  as  indicated  in  Table  1.  (Derivations 
for  these  two  cases  are  presented  in  the  next  section.) 
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The  second  approach  is  based  upon  a  scaling  invariance  developed  in 
Appendix  A  [see  alsoTtef.  8,  ch.  6].  Basically,  the  idea  is  do  consider  the 
(infinite)  class  of  processors  that  realize  a  specified  Pp  without  knowledge  of 
the  noise  level  a2,  and  to  select  that  processor  which  maximizes  Pq.  The 
resultant  processors  for  cases  (c)  and  (d)  are  identical' and  are  given  in  Table  1; 
for  case  (c)  the  processor  is  optimum  under  the  scaling  invariance  requirement, 
and  for  case  (d)  it  is  the  UMP  processor  under  scaling  invariance .  The  proc¬ 
essor  is  similar  to  that  considered  by  Scharf  and  Lytle.2 

Thus  the  ML-principle  and  the  scaling -invariance  approaches  yield  the 
same  processor  for  case  (d).  The  two.  approaches  yield  different  processors 
for  case  (c).  We  have  selected  the  processor  indicated  in  Table  1  for  both 
cases  (c)  and  (d)  because  it  realizes  prescribed  Pp  without  knowledge  of  m 
and  a2  and  is  optimum  in  the  sense  of  realizing  maximum  Pq.  The  noise- 
alone  measurements  j yj [  ^  enter  through  the  sample  power  in  the  measure¬ 
ments  . 

Case  (c)  is  somewhat  unrealistic  in  that  the  signal  strength  is  assumed 
known,  while  the  noise  level  is  not.  Case  (d)  is  an  often  encountered  situation 
resulting,  for  example,  from  a  nonstationary  noise  background  and  a  channel 
with, .unknown  or  time-varying  attenuation.  Nevertheless,  since  the  processors 
for  both  cases  are  identical  under  the  scaling  invariance  requirement,  the 
analysis  and  performance  to  be  presented  apply  equally  well  to  botli  cases. 

The  actually  attained  Pp>  will  depend  upon  the  true  values  of  m  and  a2; 
these,  in  turn,  depend  on  the  detailed  signals  transmitted,  the  noise  power  re¬ 
ceived,  and  the  receiver  filtering.  The  present  analysis  will  indicate  what 
value  of  m/a  is  necessary  in  order  to  realize,  for  a  wide  range  of  M  and  N, 
prescribed  Pp  and  PD. 

Since  the  processors  for  cases  (c)  and  (d)  are  required  to  guarantee  a 
specified  Pp  without  knowledge  of  a2,  they  will  not  perform  as  well  as  those 
for  cases  (a)  and  (b),  which  have  knowledge  of  a2.  The  additional  signal-to- 
noise  ratio  (SNR)  required  will  be  part  of  the  results  of  this  investigation. 


PROBLEM  SOLUTION 

For  case  (d),  m  and  a2  in  (2)  and  (3)  are  unknown;  however,  m  is 
known  to  be  nonnegative .  According  to  the  procedure  for  utilizing  ML  esti¬ 
mates,  we  choose  a2  in  (2)  to  maximize  p0(R)  for  a  given  observation  R  , 
and  we  choose  m  and  a2  in  (3)  to  maximize  Pi(R).  Maximization  of 
P0(R)  by  choice  of  a2  yields 
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,?-±! _ tk 

O  M  +  N 


(6) 


This  quantity  is  the  sample  variance  of  all  the  available  samples  under  hypoth¬ 
esis  H0.  Maximization  of  Pi(R)  by  simultaneous  choice  of  m  and  <r2  yields 


m 


1 


max 


(7A) 


M 

I 

i=l 


xxv*  ix 

_ El 


M  +  N 


(7B) 


Here  nij  is  the  sample  mean  of  the  M  signal -plus -noise  samples  (if  nonr 
negative)  and  a\  is  the  sample  variance  of  all  available  samples  under  hy¬ 
pothesis  (after  subtraction  of  m^  from  the  signal -plus -noise  samples). 
Substitution  of  (6)  and  (7)  into  the  LR  p^(R)/p0(R)  yields 


M+N 


W  if 


GLR(R)  = 


1  otherwise 


(8) 


Comparison  of  the  GLR  with  a  threshold  T  thus  becomes  merely  a  comparison 
of  the  sample  variances  under  the  two  hypotheses.  The  GLR  test  is  therefore  to 


choose  II ^ 


if 


>  T(>1)  and  if 


M 


x.  >0 


i=l 


(9) 


othenvise,  choose  HQ.  By  manipulating  (6),  (7),  and  (9),  the  GLR  test  may  be 
put  in  the  form 
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This  is  the  test  quoted  in  Table  1  earlier.  The  reason  for  the  choice  of  scale 
factor  as  in  (10)  is  that  r  need  vary  only  in  the  range  (0, 1).  This  follows  by 
application  of  Schwartz's  inequality  to  the  left  side  of  (10): 


for  any 


(11) 


The  form  of  the  GLIt  test  in  (10)  is  recognized  as  a  comparison  of  the 
sample  moan  of  the  signal -plus -noise  samples  with  a  scaled  version  of  the  sam¬ 
ple  root-mean-square  (rms)  value  of  all  the  samples.  It  is  a  slight  generaliza¬ 
tion  of  the  one-sided  t-test  (Ref.  i,  p.  320] .  The  test  (10)  could  bo  adopted  even  if 
signal  component  moans  on  the  M  samples  were  unequal ,  because  better  proc¬ 
essing  than  (10)  provides  would  require  more  information  than  is  generally 
available.  However,  the  present  amilysis  does  not  cover  this  more  general 
case  of  unequal'  means  (sec  Appendix  A). 

For  case  (c),  where  only  <r2  Is  unknown,  the  ML  estimates  are  given 
again  by /(>)  and.  (711)  except  than  mj  is  replaced  by  the  known  value  m.  The 
(5LR  test  takes  the  form 

M+N 

)  %  T ,  (12) 


which  can  be  manipulated  into  the  form 


This  tost  roquios  knowledge  of  the  value  of  m,  as  noted  earlier,  ;md  there¬ 
fore  is  discarded. 
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The  derivation  of  the  performance  of  the  GLR  test  (10)  is  lengthy  and  is 
carried  Putin  a  series  of  appendixes.  In  Appendix  B  the  matrix  manipulations 
that  are? needed  are  reviewed.  In  Appendix  C  the  method  of  converting  a  Her- 
mitian  form  to  a  sum  of  squares  of  uncorrelated  random  variables  (RVsfis 
given,  along  with  the  statistics  of  the  Hermitian  form  for  Gaussian  RVs.  In' 
Appendix  D  the  actual  detection  probability  of  the  GLR  test  is  evaluated  and 
found  to  be 


where* 


d t=n/M  f-,  K  =  M  +  N  -  2  . 


(14) 


(15) 


The  quantity  dp  can  be  interpreted  as  the  (voltage)  SNR  of  the  RV  on  the 
left  side  of  the  GLR  test.  That  is,  defining 


M' 

z-y;  Xj,  (i6) 

i=l 


it  is  easily  shown  from  (2)  and  (3)  that 


change  in  mean  of  z  due  to  signal  presence  _  m 
standard  deviation  of  z  a 


(17) 


Thus,  20  log  d.p  can  be  interpreted  as  a  system  output  SNR  in  dB;  it  can  be  con¬ 
verted  to  an  equivalent  input  SNR  when  the  receiver  processing  and  filtering 
operations  are  known. 


*If  M  =  1,  then  N  >  1  is  necessary  in  the  GLR  test  (10)  in  order  to  have 
a  valid  comparison.  However,  if  M  s  2,  then  N  S  0  is  acceptable.  These 
cases  are  summarized  by  requiring  MSI  and  K  s  0  for  a  meaningful  problem. 
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The  scale  factor  r  in  the  GLR  test  (10)  is  under  our  control,  taking 
values  in  the  range  (0,1),  and  is  adjusted  to  realize  a  prescribed  false-alarm 
probability.  The  false-alarm:probability  is  obtained  by  setting  the  SNR  dp  =  0 
in  (14): 


F 


oo 

=1 


dw 


wK  exp(-w2/2) 


=  f(0,r,K) 


(18) 


In  Appendix  E,  closed-form  expressions  i!or  Pp  and  simple  recursive  rela¬ 
tions  for  PD  are  derived.  These  are  used  in  the  following  section  to  obtain 
numerical  results . 

It  will  be  noticed  in  the  GLR  test  (10)  that  the  signal -plus -noise  samples 
jx|j  are  inbred;  that  is,  they  are  used  on  both  sides  of  the  comparison.  It  is 
of  interest  to  compare  this  with  the  test  that  uses  the  samples,  |xJ ,  only  ac¬ 
cording  to 


or  >  0  . 


(19) 


The  performance  for  (19)  is  easily  determined  when  we  compare  it  with  (D-27): 
test  (19)  is  already  in  the  desired  form  of  a  comparison  of  independent  RVs; 
however,  there  are  M  +  N  -  1  RVs  on  the  right  side  of  the  comparison  in 
(D-27),  whereas  there  are  only  N  RVs  in  (19).  Since  the  addition  of  more 
zero-mean  RVs  can  only  help  give  better  estimates  of  the  rms  noise  level,  the 
performance  of  the  GLR  test  (10)  must  bo  better  than  the  pei’formancc  of  test 

(19). 

As  N  tends  to  infinity  in  (10),  the  estimate  of  the  rms  noise  level  on  the 
right  side  becomes  perfect.  Test  (10)  then  becomes  a  comparison  with  a  con¬ 
stant,  mid  the  detection  and  false-alarm  probabilities  are  then 


PD=*(dT-A),  PF  =<!>(- A). 


(20) 


These  are  the  values  approached  by  (14)  and  (18),  respectively,  as  K  tends  to 
infinity  and  r  tends  to  zero  in  such  a  way  that  a  specified  Pp  is  realized  (by 
choice  of  A). 
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RESULTS 

It  will  be  seen  from  (18)  that  the  onfy  way  that  M  and  N  enter  Pp  is 
through  their  sum;  that  is,  K=M  +  N-  2.  This  is  due  to  the  way  the  GLR  test 
was  set  up  in  (10);  it  will  be  noticed  that  M  enters  the  test  separately  as  a 
scaling  factor.  For  Pp  =  10-n,  n=  1(1)8,  and  K  =  0(1)10(5)25,  required 
values  of  r  in  the  test  (10)  are  presented  in  Table  2. 

In  Figs.  1-14,  -PD  is  plotted  versus  dp,  with  Pp  as  a  parameter,  for 
K  =  0(1)10(5)25.  The  curve  for  K  =  « ,  ;as  discussed  with  respect  to  (20),  is 
presented  in  Fig.  15  for  comparison  purposes.  It  is  immediately  obvious  from 
the  curve  for  K  =  0  that  performance  for  M  =  2,  N  =  0  or  M  =1,  N  =  1  is 
very  poor.  Inadequate  estimation  of  the  noise  level  requires  a  high  threshold- 
level  setting  for  low  Pp  and  thereby  forces  down  the  attainable  values  of  PD. 
In  fact,  even  for  dp  =  20,  Pq  can  not  reach  a  value  of  0. 5  for  Pp  £  10"2. 

The  situation  for  moderate  Pp  is  quickly  improved  by  the  addition  of  a  few 
extra  samples ,  as  the  curves  for  K=  l,  2,  and  3  show.  However,  high-quali¬ 
ty  performance  is  not  realized  for  very  small  Pp  until  many  samples  are 
available;  for  example,  even  for  dT  =-:  20,  PD  can  not  reach  a  value  of  0.5  for 
Pp  =10~8  until  K>  8. 


The  addition  of  another  independent  sample  always  improves  perform¬ 
ance;  however,  the  improvement  is  greater  if  M,  rather  than  N,  is  increased 
by  one.  This  may  be  seen  by  noting  that  increasing  N  by  one  increases  K  by 
one ,  whereas  increasing  M  by  one  increases  both  K  and  dp ,  Thus ,  an  addi¬ 
tional  potential  signal  sample  is  always  preferable  to  a  noise-alone  sample. 

The  improvement  to  be  gained  by  collecting  additional  samples  is  more 
obvious  in  Figs.  16  and  17,  which  fire  plots  of  the  values  of  dp  versus  K  re¬ 
quired  to  realize  P£)  =  0,5  for  various  values  of  Pp.  Figure  17  shows  dp  in 
dB,  that  is,  20  log  dp;  straight  lines  have  bet-n  drawn  between  points  for  ease 
of  interpretation.  The  horizontal  tic  marks  at  the  right  edges  of  the  figures  in¬ 
dicate  the  required  value  of  dp  for  K  =  «>  and  are  therefore  the  asymptotes  of 
the  curves. 

For  P,p  -  10"1,  the  curve  has  almost  reached  its  limiting  value  at 
K=  1  or  2.  For  Pp  =  10“2,  the  required  value  of  dp  for  K  =  0  is  21.5,  but 
the  required  value  of  dp  for  K  =  1  is  5.83,  a  drop  of  11.3  dB,  which  is  a 
marked  improvement  for  the  addition  of  one  more  sample.  For  Pp  =  10"®, 
however,  the  curve  is  still  dropping  at  K=  25. 
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REQUIRED  VALUES  OF  SCALE  FACTOR  r  IN  GLR  TEST  (EQ.  10) 


K 

F 

m 

io"2 

l<f3 

io"4 

io-5 

io-6 

l<f7 

M 

O 

1 

00 

0 

.9511 

.9995 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

1.0000 

1 

.8000 

.9800 

.9980 

.9998 

1.0000 

1.0000 

1.0000 

1.0000 

2 

.6870 

.9343 

.9859 

.9970 

.9993 

.9999 

1.0000 

1.0000 

3 

.6084 

.8822 

.9633 

.9884 

.  9963 

.9988 

.9996 

.9999 

4 

.5509 

.8329 

.9350 

;  .9743 

.9898 

.9960 

.9984 

.9994 

B 

.5067 

.7887 

.9049 

.9564 

.9799 

.9907 

.9957 

.9980 

.4716 

.7498 

.8751 

.9365 

.  9674 

.9832 

.9913 

.9955 

B 

.4428 

.7155 

.8467 

.9156 

.9531 

.9738 

.9853 

.9918 

8 

.4187 

.  6851 

.8199 

.8947 

.9378 

.9630 

.9779 

.9868 

9 

.3981 

.6581 

.7950 

.8742 

.9219 

.9512 

.9694 

.9808 

10 

.3802 

.6339 

.7717 

.8544 

.9060 

.9389 

.9601 

.9739 

15 

.3170 

.5425 

.6777 

.7676 

.8303 

.8751 

.9076 

.9313 

20 

.2774 

.4815 

.6099 

.7001 

.7665 

.8167 

.8553 

.8853 

25 

.2497 

.4372 

.5587 

.6468 

.7138 

.7662 

.8080 

.8417 
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If  numerous  signal  samples  are-already  available,  such  as  M  >10,  Figs. 
16  and  17  indicate  that  it  is  not  worthwhile  to  collect  any  noise-alone  samples 
unless  a  very  small  Pj.  is  desired.  For  example,  the  curve  for  Pp  =  10-2  in 
Fig.  17  indicates  that  the  required  value  of  dip  would  drop  less  than  2  dB  by 
increasing  K  from  8  to  25,  which  is  within  one  dB  of  the  K=  <*  case.  How- 
e\er,  at  Pp  =  10"®,  a  7-dB  reduction  is  possible  by  increasing  K  from  8  to 
25. 


The  total  received  signal  energy  is  proportional  to  Mm2 .  If  this  total 
energy  is  kept  fixed,  dividing  it  into  more  components  by  increasing  M  will 
increase  K  while  dp  remains  constant.  In  Figs.  1-14,  it  is  seen  that  per¬ 
formance  improves  monotohically;  that  is,  the  more  the  total  signal  energy  is 
fractionalized,  the  better  the  performance  approaches  the  K=  «>  limit  shown 
in  Fig.  15-.  This  is  due  to  the  fact  that  coherent  addition  of  the  signal  compo¬ 
nents  is  presumed  (even'  at  low  SNR  per  component),  while  the  noise -power 
estimate  becomes  more  stable.  In  practice,  the  required  coherent  processing 
may  be  unattainable  for  low  SNRs. 

A  word  of  caution  is  in  order  regarding  the  use  of  Figs.  1-17.  The  quan¬ 
tity  dp  depends  on  M,  as  indicated  in  (17).  Thus,  if  M  changes,  both  K 
and  dp  change;  however,  if  N  changes,  K  alone  changes.  The  plots  pre¬ 
sented  here  can  be  used,  for  example,  to  compute  individual  SNR  m/a  curves 
for  any  values  of  M  and  N,  but,  in  order  to  keep  the  number  of  curves  down  to 
a  reasonable  level,  'this  procedure  was  not  adopted.  Notice  that  the  case  of  no 
noise-alone  samples,  N  =  0,  is  subsumed  under  the  above  results  by  setting 
K=  M  -  2. 

Curves  of  required  SNR  for  other  detection  probabilities,  such  as  0. 9  or 
0.99,  can  be  easily  determined  from  Figs.  1-15.  Operating  characteristics 
for  other  ranges  of  K  or  SNR  can  be  determined  from  the  general  formulas  in 
Appendix  E. 


DISCUSSION 

Operating  characteristics  for  detection  of  coherent  signals  in  Gaussian 
noise  of  unknown  level  have  been  presented.  The  processor  considered  is  the 
ML  detector  in  the  case  of  unknown  signal  level.  It  is  the  optimum  processor  ‘ 
in  the  following  sense:  out  of  the  (infinite)  class  of  processors  that  yield  a 
specified  Pp  without  knowledge  of  the  noise  level,  it  yields  the  maximum  Pq 
for  known  signal  level  and  is  UMP  for  unknown  (positive)  signal  level.  The 
scaling-invariance  optimum  with  respect  to  unknown  noise  level  generally  yields 
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processors  that  are  not  UMP  with  respect  to  the  parameters  in  the  PDFs  under 
the  two  hypotheses  H0  and  H-^.  Thus  one  must  generally  resort  to  a  different 
approach,  such  as  the  principle  of  ML,  that  eliminates  unknown  parameters. 

If  the  polarity  of  the  mean  m  in  the  PDF  (3)  is  not  known  to  be  nonnega¬ 
tive,  the  least  favorable  situation  occurs  when  positive  and  negative  values  oc¬ 
cur  equally  often.  Then  the  average  LR  test  takes  the  form  of  (10),  except  that 
the  left  side  is  replaced  by  its  magnitude.  (This  test  is  the  same  as  that  yielded 
by  the  optimum  processor  forced  to  operate  with  the  samples  |^/y^|  and 
|  y/yjj)  (see  Appendix  A,  (A-17)  -  (A— 20)). )  Derivation  of  the  performance  of 
this  processor  parallels  that  given  in  this  report  up  to  (D-27),  at  which  point 
v^  is  replaced  by  its  magnitude.  The  detection  probability  is  then  given  by 


oo 

r 


0 


wK  exp(-w2/2) 
JK-P/2 


=  f(dT,r,K)+f(-dT,r,K). 


(21) 


The  false-alarm  probability  is 


PF  =  2f(0,r,K),  (22) 

which  is  double  expression  (18).  The  performance  of  this  processor  is  poorer 
than  the  one  analyzed  in  this  report  because  of  less  available  knowledge.  The 
exact  quantitative  behavior  may  be  obtained  from  (21),  (22),  and  Appendix  E, 
but  has  not  been  pursued. 

Coherent  processing  has  been  presumed  here.  When  the  received  signal 
is  narrowband,  phase  tracking  is  often  difficult  to  accomplish;  then  phase- 
incoherent  processing  is  often  adopted  with  an  attendant  loss  of  performance. 
Under  certain  conditions,  such  as  multipath  fading,  the  received  signal  pos¬ 
sesses  no  deterministic  behavior  and  is  a  stochastic  process.  The  two  cases 
of  phase-incoherent  and  stochastic  signal  statistics  will  be  the  subjects  of  fu¬ 
ture  work. 
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Appendix  A 

OPTIMUM  PROCESSOR  FOR  ARBITRARY  SCALING 


Buppcse  n+1  observations  x-^, . . .  ,xn,xJi+1  are  made  of  a  process  of 
unknown  noise  power  level.  Let  the  PDFs  of  the  observations  be  p  and  q  un¬ 
der  hypotheses  and  H0,  respectively;  the  observations  need  not  be  statis¬ 
tically  independent.  We  want  a  processor  that  yields  a  specified  Pp  without 
knowledge  of  the  noise  power  level  and  that  realizes  maximum  Pq.  Since  the 
desired  processor  is  to  realize  a  specified  Pp  without  knowledge  of  the  noise 
level,  it  must  operate  equally  well  on  the  scaled  samples  cx-p  . . .  ,  cxn, 
cxn+i ,  where  c  is  any  positive  constant,  since  these  could  just  as  well  have 
been  the  sample  values  under  HQ.  In.particular,  we  could  choose  c  =  |xn+i|-1 
for  the  scale  factor  and  still  expect  the  desired  processor  to  perform  equally 
well . 


The  optimum  processor,  in  the  sense  of  yielding  maximum  PD,  for  the 
scaled  samples 


z 


k 


l£k£  n+1 , 


(A— 1) 


in  one  that  computes  the  LR  of  these  samples  and  compares  the  LR  with  a 
threshold.  Noting  that  zn+i  =  +1,  we  have 


LR<zi . 2nIVi 


+  l)s 


p(z^»  •  •  •  » 
q(zi»  ♦  •  •  * 


z  z  „ 
n  n+1 


z  z 

n  n+1 


=  +l) 
^±1)' 


(A -2) 


Now,  under  Hj, 


Prob<zi<  V"  -  v  znl  Vi=±1)=prob(xi<  !Vilzi'  •  •  •  -  V  lx„«lzJVi=il) 


B<Vi>  IViizi 


% 


dx 


m+1 


dXj . . . 


lXn+llZn 

r 


P(xi . VW’  (A"3) 


A(zn+1) 


Preceding  page  blank 
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where 


(A<W-  B<w)  ■ 


(°»  °°)»  Vi  =  +1l 


zn+1  =  -ij 


(A -4) 


Then 


B(z  ,) 
'  n+1 


P<zl . Zn|Zn+l  =  i1)  = 


n 


‘’VlIVll  p<lxn+llJSl--IVllVxn+l) 


oo 

=  ^dxx*1  ....XZ^jx)  . 


(A-5) 


A  similar  relation  holds  for  q  in  terms  of  q.  Then  (A -2)  becomes 

© 

dx  xn  p(xz, , . . . , xz  ,  +x) 

1  n  ~ 


Ltt<zi . 2„IVi  =  *1,= 


OO 

I- 


c 

dx  xn  q(xz^, . . .  .xz^.+x) 


(A-6) 


This  is  a  general  relation  for  the  LR  and  indicates  how  the  scaled  samples 
jz^l  should  be  processed. 

Let  us  apply  the  general  relation  (A-6)  to  the  following  example,  which  is 
actually  more  general  than  the  one  considered  in  the  main  body  of  the  text.  Let 


££  (  2  ~1/2  r 

P(x!>  •  •  •  ’  Yxn+i)  =  JJ  <2™  >  exP 

k=l 


<w 


2a 


(A-7) 
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The  PDF  q  is  given  by  the  same  formula  with  jin^}  set  equal  to  zero.  The 
jn%  j  need  not  be  equal,  but  they  are  assumed  known  for  the  moment;  a2  is 
unknown'.  Define 


S  = 


L  +  m  , 

B  =  — . S3* 

& t  'JsTi  ff 


(A-8) 


Then  the  .numerator  of  (A-6);  is  given  by 


-(n+l)/2 

oo 

% 

i  n 

■  x^(S+l)  -  2x(L+m^+1)  +  U  " 

\2irff  J 

dx  x  exp 

„  2 

m 

2cr 

0 

=  ^2tt(S+1) J  exp  -~J  |  dt  tn  exp  £  ~  t2  +  /?+t  j  .  (A -9) 

0 


The  denominator  of  (A-6)  follows  from  (A-9)  by  setting  {m^}  equal  to  zero. 
Then  (A-6)  becomes 


LR(z1> . 


•,2nivr±1,=ex|>["f^'] 

u  O 


dt  tn  exp 


':b  2+/v 


..  .n  f  if2! 
dt  t  exp  -  —  t 


*  (A-10) 


0 


Without  having  to  evaluate  the  integrals,  (A-10)  is  seen  to  be  monotonically  in¬ 
creasing  with  /3+,  as  depicted  in  Fig.  A-l.  Therefore,  comparison  of  the  LR 
with  a  thresholdas  equivalent  to  comparison  of  /3+  with  a  threshold.  From 
(A-8),  this  is 
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Fig.  A-l.  Dependence  of  the  Likelihood  Ratio  on  /?+ 


L  +  m  ,1 
-  n+1 

'J&TT 


*V 


(A— 11) 


since  a  ,  although  unknown,  is  positive.  Using  (A-8)  and  (A-l)  we  express 


ft'  x 

L  +  m  =  )  m.  - + 

-  n+1  k  ix  | 


m 


x  n+1 

n+1  1 


„  ,  I  Vil  n+l  l  Vil  Ix„+Il  „  , 

k=l  k=l 


E  Vk 


and 


„  .  /  n  xl  1/2  n+1  .1/2 


(A-12) 


Therefore  the  LR  test  (A-ll)  becomes 


V-  >  /£*  2\1/2 

Ev^E**)  ■ 

k=l  'k=l  ' 


(A -13) 


This  is  the  optimum  invariant  test  if  {m^}  are  known;  jm^}  can  be  positive, 
negative,  or  of  mixed  polarities.  Threshold  v ^  is  chosen  for  specified  Pp. 
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The  LR  test  in  (A-13)  can  be  expressed  as 


“k  „  2\1/2 

Slmmax|Xk<“2(^Xk) 

k=l  k=l 


(A -14) 


which  does  not  require  knowledge  of  absolute  signal  level,  but  only  relative 
levels .  This  is  a  UMP  test  under  scaling  invariance  for  unknown  signal  level 
provided  the  relative  signal  strengths  .|nik/lmrnaxl! n+1>  can  ^  mixed 

positive  and  negative,  are  known.  1 

A  special  case  of  (A-14)  is  afforded  by 


m^-mX)  for  lSkSM;  otherwise,  =  0 , 


(A -15) 


where  m  is  unknown.  Then  there  follows 


M  n+1  i/o 

Z'V<'2(£\) 

k=l  k=l 


(A-16) 


There  is  no  need  to  know  m;  this  is  a  UMP  test  under  scaling  invariance  and 
is  recognized  as  the  test  shown  in  Table  1,  with  the  identification  of  n  +  1  = 

M  +  N. 

It  is  worth  noting  that  if  only  the  n  ratios 


\ 

v  ~  1  £  k  £  n , 

•’k  x  * 
n+1 


(A-17) 


are  available  for  making  decisions,  the  LR  is  given  by 
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Lack  of  knowledge  about  the  polarity  of  the  samples  requires  talcing  a  magnitude 
of  the  linear  sum.  This  test  will  perform  more  poorly  than  (A-13)  because  it  is 
operating  with  less  knowledge. 

The  procedure  in  this  appendix  is  useful  if  it  results  in  a  UMP  test  with 
respect  to  the  parameters  in  the  PDFs.  Although  this  happens  for  the  example 
considered  in  this  report,  it  is  not  generally  the  case,  and  realization  of  a 
specified  Pp  is  not  always  attainable.  Thus,  it  is  often  necessary  to  resort  to 
a  different  approach,  such  as  the  principle  of  ML,  that  eliminates  unknown 
parameters. 
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Appendix  B 

MATRIX  MANIPULATIONS:  CHARACTERISTIC  VALUES,  CHARACTERISTIC 
VECTORS,  AND  NORMALIZED  MODAL  MATRIX 


Let  A  bean  MxM  Hermitian  matrix  of  complex  elements.  Let* 

A*i  =  Xi*i?  lsisM*  (S'1) 

where  is  an  M  x  1  column  matrix,  is  the  i-th  characteristic  value  of 
A,  and  ©^  is  the  i-th  (right)  characteristic  vector  of  A.  Equation  (B-l)  can 
be  written 

M 

aijeij  =  Xieii*  1  £ *  -  M  •  (S-2) 


Let  Q  =  [o^  ...  ©mI:  this  is  the  normalized  modal  matrix  of  A  [Ref.  9,  pp. 
37-39  and  p.  47] .  Also  let 


x  = 


(B-3) 


Then  (A-l)  can  be  expressed  as  the  following  sequence  of  equations: 


Ae ^  =  Xj2®i»  l  si  <M, 


^el  ...  A©m)=  ^iei  •••  xm®M^  ’ 


Ate^  ...  ©jyj]  —  [©^  ...  ©MJ  X, 


AQ  =QX, 

A  =  QXQ"1. 

*See,  for  example,  Ref.  9,  secs.  1.11  and  1.16. 


(B-4) 
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Now 


[91  ®M]  1  ’ 


(B-5) 


since  the  characteristic  vectors  are  orthonormal  [Ref.  9,  p.  44] .  Therefore 
Q  H  =  CT1,  and  (B-4)  can  be  expressed  as 

A  =  Q\QH  (^QH\Q) .  (B-6) 

Alternatively,  we  can  express 

X  =  QHAQ  .  (B-7) 

The  j,k-th  term  of  QHQ  is 


M 

M 

Vk=Eei/w 

=  VEvIr 

(B-8) 

i= 1 

i= 1 

and  the  j,k-th  term  of  QQ^  is 

M 

M 

EvA-  * 

k=Seljeik* 

(B-9) 

jg=i 

i= 1 

From  (B-4),  the  following  sequence  of  equations  holds: 


-H.  - 

Q  A  -  XQ  > 


r®Hi 

*i 

rtf] 

i 

< 

W  r-( 

1* 

rx  «Hi 
iei 

o« 

> 

ii 

>* 

• 

• 

•H 

L 

* 

t 

• 

e«A 

= 

x,  eu 

L  MJ 

L  M  J 

"  M  MJ 
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e|A  =  l  <  H  <  m  .  (B-lO) 

If  we  define  the  (left)  characteristic  vectors  and  numbers  of  A  as  Vg  and  7 ^  , 
respectively,  then 

vJA  =  7iVi’  (B-ll) 

where  Vjj  is  an  M  x  1  column  matrix.  Comparison  of  (B-10)  and  (B-ll)  re¬ 
veals  that 

y j  1!^Mi  (B-12) 

thus  the  characteristic  numbers  are  equal,  whereas  the  characteristic  vectors 
are  conjugates. 
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Appendix  C 

REDUCTION  OF  HERMITIAN  FORM 


Two  problems  will  be  addressed  in  this  appendix:  converting  a  Hermitian 
form  to  a  sum  of  squares  of  uncorrelated  RVs  and  determining  the  statistics  of 
the  Hermitian  form  when  the  RVs  are  Gaussian. 

Let  X  be  an  M  x  1  column  matrix  of  complex  RVs,  and  let  B  be  an 
M  x  M  Hermitian  matrix.  We  do  not  assume  that  X  is  a  collection  of  Gaussian 
RVs,  so  that  we  allow  complete  generality  in  the  first  problem.  The  Hermitian 
form  of  interest  is 


F(X)=XHBX.  (C-l) 

Since  3  is  Hermitian,  the  form  F  is  real.  Let 

E{X}  h  m  (C-2) 

be  the  means  of  the  RVs,  and 

Cov|X(  =  E](X-m)(X-m)H}  s  k  =  KH  (C-3) 

be  the  covariance  matrix  of  the  RVs;  m  and  K  are  arbitrary,  except  that  K 
must  be  an  allowable  covariance  matrix  (that  is,  nonnegative  definite). 

We  define  transformed  RVs  V  by 


V  = 


zk'1/2x 


(C-4) 


where  Z  is  MxM  and  is  yet  to  be  chosen.  From  (C-2)  and  (C-3), 


E  |V}  =  ZK"l/2m  , 

Cov|V(  =  E  )ZK"1/2(X-m)(X-m)HK“1/2ZHi  =  ZZH.  (C-5) 


Preceding  page  blank 
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This  last  matrix  is  desired  to  be  diagonal,  for  then  the  RVs  V  will  be  uncor¬ 
related.  At  the  same  time,  the  quantity 

VHYV  =  XHK"1/2ZH  YZK"1/2X  (C-6) 

will  be  set  equal  to  F(X)  by  choice  of  Y ,  which  is  also  MxM,  In  order  to 
accomplish  this,  we  must  have 

K-1/2ZH  YZK"l/2=  B,  (C-7) 

or 

ZU YZ  =  K1/2  B  K1/2  =  A=  AH.  (C-8) 

But  A  is  a  known  matrix,  since  K  and  B  arc  known;  solve  for  A's  nor¬ 
malized  modal  matrix  Q  and  characteristic  value  matrix  X .  Then,  from 
(B-C), 

A  =  QXQH  .  (C-9) 

If  we  choose 

2  =  Q*1,  Y  =  X  ,  (C-10) 

(C-8)  is  certainly  satisified.  Also,  (C-5)  becomes,  by  the  use  of  (B-5), 

Covjv}  =  QHQ  =  I  ,  (C-ll) 

which  is  diagonal  as  desired.  At  the  same  time,  (C -8)  yields 

M 

F(X)=  VHYV  =  VHXV  =J]xi|vi|2-  (C-12) 

jNl 
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Thus  F  is  a  sum  of  (magnitude)  squares  of  uncorrelated  RVs  V .  The  only 
remaining  statistics  are  the  means 

Ejv}  =  QHK'1/2m  (C-13) 

obtained  by  using  (C-5)  and  (C-10). 

To  summarize,  A  is  evaluated  from  K  and  B  according  to  (C -8); 

Q  and  X  are  computed  (see  Appendix  B);  then  F  is  given  by  (C-12), 
where  RVs  V  have  the  covariance  matrix  I  and  means  fi  (C-13). 

Now  we  specialize  the  above  results  to  the  case  in  which  RVs  X  are 
Gaussian  and  real ,  and  B  is  a  real  symmetric  matrix.  Since  V  is  a  linear 
transformation  of  X  (sec  (C -4)),  RVs  V  are  Gaussian;  they  are  also  real 
because  A  is  real.  From  (C-ll)  and  (C-13),  the  PDF  of  V  is 

P(V)  *  JJ  |(2rf 1/2  exp  (vg"^)2]|.  (C-14J 

i=i 

The  characteristic  function  (CF)  of  form  F  then  follows,  from  (C-12),  as 

M 

f(€)  =  E{exp(i*F(X))}  =  E  |  exp  (if  ^  X^vj)} 

i=  1 

M  r 

=  JI  {  dvj2  exp(ifxj,v|)(27r)“l/2  exp[-f(^'^)2]}- 

i=l  ^ 

TTTT  -1/2  /  \) 

=  II  (1"i2'V)  ’  <c-15> 

M= 1 

where  X  are  the  characteristic  numbers  of  A  given  by  (C-8),  fi  is  given  by 
(C-13),  and  Q  is  the  normalized  modal  matrix  of  A .  This  is  the  desired 
result. 
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The  PDF  of  RV  F  can  be  obtained  via  a  Fast  Fourier  Transform  of  the 
CF  f,  and  the  cumulative  distribution  of  RV  F  can  be  found  by  means  of  the 
techniques  described  in  Refs.  10  and  11. 


As  a  special  case  of  (C-15),  consider 

Xj2=X,  l£i<M(X>0).  (C— 16) 


The  CF  of  the  PDF 


_1 

2X 


x  >  0  (X  >  0) 


(C-17) 


is  [Ref.  12,  £q.  (3.433)] 


exp(rr| tfX1-12**)"”1 


(C-18) 


Therefore  the  PDF  of  F  follows,  from  (C-15),  as 

2 


^T  F V  F  \M//4"l/2 


2X  GXP  \  2  2XA  2 


ju  A> 

T 


M/2 


■U)- 


F  >  0  ,  (C— 19) 


where 


(C-20) 
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In  order  to  evaluate  these  quantities,  we  refer  to  (B-l)  and/(D-ll)  to  obtain 

A'^  =  <r2(l-r2)M« , 

2  2 

A 9ji  =  -<r  r  ,  2  <  J  <  M  .  (D-14) 

The  solution  for  0-^  is 

.  .,-1/2- 

®j_  =  M  1  ,  (D-15) 


from  substitution  in  the  top  equation  of  (D-14);  and  using  (D-10)  and  (D-6): 

A0X  =  Am“1/21  =  M"l/2<r2Bl  =  M’l/2cr2(l-r2)Ml  =  /(l-r2)!^  =  . 

(D-16) 

Therefore,  from  (D-13)  and  (D-8), 


m,  T  m, 

"kl-— ' 1 


(D-17) 


where  we  have  defined 


(D-18) 


This  quantity  can  be  interpreted  as  a  (voltage)  SNR  of  the  RV  on  the  left  side  of 
the  GLR  test  (see  discussich  of  (16)), 

In  order  to  evaluate  vug  for  i  >  2,  we  premultiply  the  second  equation 
of  (D-14)  by  1T: 


1  At*,,  =  -  <r2 r2M  1  t|,  2  <  i  < 


M 


(D-19) 


But 


l‘A  =  (A  1)T  =  <r2(l-r2)MlT 


(D-20) 
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from  (D-16),  so  (D-19)  becomes 


2  2  T  2  2  T 

a  (1-r  )Ml  ^  =  -ff  r  Ml  ,  2  <i<  M, 

T 

1  =0,  .  2  <  J?<M . 


Combining  (D-13),  (D-17),  and  (D-21), 


'Vkl’  i-1 


0,  2<j2<M 


,  k  =  0  or  1 . 


(D-21) 


(D-22) 


Therefore  (C-13)  becomes 

EfV1I=dTikl’  E|vfi}=0,  2<i<M.  (D-23) 

The  RV  q  in  (D-5)  is  now  expressible  as 

M  M  N 

“ -  £>]  - r H ■  AwW2  -  Ml  £vj  -  r2M  £  y? 

i=2  j=l  1 


=Aih2,vi-2(z^i:yH]' 


i=2  j=l 


(D-24) 


from  (C-12),  (D-ll),  and  (D-l).  But  since 

v  =  zk"1/2x  =|qtx 

from  (C-4),  (C-10),  and  (D-9),  it  follows  from  (D-15)  that 
„  le1  y  1  -1/2  -T«  1 

1x=^7Z,xi- 

i=l 


(D-25) 


(D-26) 
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Defining  Zj  =  y^/a  ,  (D-4)  becomes,  by  using  (D-l),  (D-24),  and  (D-26), 


(D-27) 


But  all  the  R Vs  V  and  Y  are  independent  and' Gaussian.  Therefore,  using 
(C-ll),  (D-23),  and  (3)  gives 

Pjfrj)  =  (27T)"1/2  expt-^-d,^2^)  , 

P^)  =  (27r)_l/2  exp(-vj/2),  2  <  &<  M , 


Pl(z. )  =  (2*)" */2  exp(-z2/2),  1  <  j  <  N  . 


(D-28) 


It  follows  that  the  PDF  of 


,  M  N  \l/2 

i= 2  j=l 


(D-29) 


is  [Ref.  14,  Eq.  (26.4)] 


,  .  wK  exp(-w2/2) 

P  W  ~  2(K-l)/2  ’  W  °  ’ 


(D-30) 


where 


K  =M  +  N  -2. 


(D-31) 
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Then  (D-27)  becomes 


PD  =  Prob  (v1> 


w  HJ 


oo  eo 


where 


0 


sf^.r.K), 


<J>(x) 


X 

■I 


dt  (2tt)~1^2  exp(-t2/2)  5 


■1 


dt  <t>(t) . 


(D-32) 


(D-33) 


The  false-alarm  probability  follows  by  setting  d-p  =  0  (m=0)  in  (D-32). 

The  above  derivation  has  tacitly  assumed  M£2.  However,  it  may  readily 
be  shown  by  a  separate  derivation  that  (D-32)  is  also  correct  for  M=l,  N=l. 
Therefore  (D-32)  holds  for  KSO,  as  mentioned  in  the  footnote  to  (14)  in  the 
main  text. 
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Appendix  E 

REDUCTION  OF  EQUATION  (D-32) 


Interest  here  lies  in  evaluating  (D-32): 


PD  =  I(dT’r,K)  = 


J  K  ,  2/0. 

.  w  exp(-w  / 2)  ^ 

dW  /T,  n  /n  /VJ.1N  4*(drp 


£7 


,),  K2  0.  (E-l) 


First,  for  K=  0, 


OO  / 

*  l/2 

f(dT,r,0)=  dw(|)  exp(- w2/2)  4'(dT w) 


=  2L(0 


ii  ■  — 

,-Jl-T2  dT> 


(E-2) 


[Ref.  14,  Eq.  (26.3.3)].  Since  this  last  function,  L,  is  fundamental  [Ref.  14, 
Eq.  (26.3.20)] ,  (E-2)  can  not  be  reduced,  and  must  be  numerically  evaluated. 
This  problem  is  discussed  in  Appendix  F . 


For  K=  1,  integrate  by  parts,  letting 


to  obtain 


2 

u=  4>(d  -  — 1  «l3=tw),  dv  =  dw  w  exp(~w  /2) , 
.  T  Jl-r 


2.  ,2 


f(dT»r,  1)  =  4>(dT)  -  r  exp(-(l-r  )  d^/2)  ^(rd^,) . 


(E-3) 


(E-4) 
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For  K>2,  integrate  by  parts,  letting 

u  =  wK  1  4>(dT  — dv  =  dw  w  exp(-w2/2) ,  (E-5) 

Jl-v 


to  obtain 


f(dT,r,K)  =  f(dT,r,K-2)-g(dT,r,K-i)}  K>2,  (E-6) 


where 


CO 

1  r 

r 


g(dT,r,K),[2K/2r(|  +  1)] 


dw  wKexp(-w2/2)  ^(dT  -~7==f  w),  K  £  0 , 

vl~r 

(E-7) 


and  </>  is  defined  in  (D-33).  Using  (E-4),  (E-6)  can  be  expressed  as 

K-l 

.  *(V  -  X  S(dT>r,n),  K  =  1, 3, 5, . . . 


f (dT » K)  - 


n=0 
n  even 

K-l 


1  f(dT,r,0)  -  ^  g(dT,r,n),  K  =  2,4,6, 


(E-8) 


n=l 
n  odd 


where  we  have  noted  that  the  last  term  in  (E-4)  is  g(dj>,r,0);  that  is,  by  direct 
integration  of  (E-7)  for  K  =  0, 


g(dT,r,0)  =  r  exp(-(l-r2)d£/2)  4>(rdT) . 


(E-9) 


Now  we  have  the  problem  of  evaluating  the  g-functions  in  (E-7).  Again, 
integrate  by  parts  for  K  >  1,  letting 
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Then 


K~1  r  2 

u  =  w  0(dT  --j==-w),  dv  =  dw  w  exp(-w  /2) .  (E-10) 

Jl~r 


[uv]  =  exp(-w2/2)  wK-1  0(dT  -~J=%w)j  =  5kl  •  (E-11) 


and  there  follows 


g(dT,r,K)  =  r  X- r2  [“  exp(-d^,/2)5kl  "JSfaj. > r. K-l)] 


+  (l-r2)  g(dT,r,K-2) 


where  the  last  term  is  absent  if  K  =  1,  Therefore 


(E-12) 


g(dT,r,  1)  =  r X?  [“ exp(-d2/2)  +Jf dT  g(dT,r,0)]  ,  (E-13) 


and 


g(dT,r,K-l) 


+  ~  (l-r2)  g(dT,r,K-2),  K  >2  .  (E-14) 

Thus,  g'(d'i’,r,0)  is  evaluated  from  (E -9),  g(d-p,r,l)  from  (E-13),  and,  for 
K>2,  g(dT,r,K)  from  (E-14).  Then  PD  =  f(dx»r,K)  is  evaluated  from  (E -2) 
and  (E-8).  For  K  odd,  nothing  worse  than  a  ^-function  need  be  evaluated.* 


♦See,  for  example,  Ref.  14,  Eq.  (26.2.17). 
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Also,  the  recurrence,  (E-14),  contains  only  positive  terms  and  thereby  retains 
accuracy  for  large  K. 

The  false  alarm  probability  is  obtained  by  setting  dp  =  0  in  the  above 
results.  From  (E-l), 


PF  =  f(0,r,K). 

Now,  for  K=0,  using  (E -2)  and  Ref.  14,  Eq.  (26.3.19),  gives 
f(Q,  r,  0)  =  2L(0, 0,  -r)  =  —  -  —  arc  sin(r) . 

£,  7T 


(E-15) 


(E-16) 


The  expressions  for  g(0,r,K)  take  on  very  simple  forms,  as  may  be  seen 
from  (E-9),  (E-13),  and  (E-14).  Then 


(E-17) 

Equations  (E-16)  and  (E-17)  constitute  closed-form  solutions  for  the  false- 
alarm  probability  (E-15).  For  each  value  of  K,  r  can  be  selected  to  realize 
a  prescribed  Pp.  Then  Pp  can  be  evaluated  versus  dp  from  (E-2)  and 
(E-8). 
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Appendix  F 

EVALUATION  OF  EQUATION  (E-2) 


We  have,  from  (E-2), 
:s1/2 


f  /2y2  2 

f(d^,,r,0)  =  dw(-)  exp(-w  /2) 


dv(2? r)"1//2  exp(-|(v-dT)2)  .(F-l) 


rw 


X? 


Let  w  -  p  cos 0,  v  =  p  sine.  Then,  expanding  exp(d-p  p  sine)  in  a  power  series 
to  eliminate  cross-product  terms, 


f(dT,r,0)  =  iexp(-d2/2) 


00 

|d" 

0 


7r/2 

1  2 

do  exp  (-  “  p  +  d^,  p  sin  e) 

arcsin(r) 


oo 

■E 

n=0 


,n  oo 


—  exp(-d^/2)  —• 


dp  p 


n+1 


P  7 r 

/2  n 

* 

) 

do  sinn0 

J 

-arcs 

;in(r) 

(P-2) 


n  2 

In  the  p  integration,  integrate  by  parts  using  u  =  p  ,  dv=  dpp  exp (-p  /2);  do 
likewise  in  the  0  integration,  using  u=sinn_^e,  dv  =  desinO.  The  two  follow¬ 
ing  resulting  recurrence  relations  enable  rapid  determination  of  the  series 


(F-2): 
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1/2 


Al(dT^=  Ml)  W* 

4 

An(dT)=^rAn-2(dT)t  n*2’ 


(F-3) 


and 


k  o  1/2 

B0<r)  =  J  "  arcsin(r),  B1(r)  =  (1-r  )  , 


n-1/.  2  \  '  “ 

_  r  v  ~r  )  +  (p~1)Bn_2(r) 


1/2 


B  (r)  = 
n 


n 


,  n  >2 . 


(F-4) 
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